Student Evaluation Research Articles

대학 정량지표를 통해 본 대학혁신지원사업의 성과와 시사점

Objectives This study analyzed the performance of university innovation support projects through quantitative in-dicators of universities. Methods A paired t-test method and one-way analysis of variance were used as research methods. Results As a result of the analysis, the acquisition rate of full-time teachers and the recruitment rate of students were lower than before the university innovation support project, while the education cost reduction rate, the total number of courses per student, the appropriateness of the lecture size, the recruitment rate of new students, and the employment rate of graduates were higher than before the university innovation support project. The recruit-ment rate of enrolled students and the employment rate of graduates were higher in the metropolitan area than in the non-metropolitan area. According to the university size, there was no difference in the rate of change in all indicators except for the enrollment rate, and in the case of the enrollment rate, large universities performed better than those that did not. Conclusions This study is significant in that it has confirmed that the university innovation support project is ach-ieving quantitative as well as qualitative performance of various university innovations, and balances according to university regional conditions and size.

APPLICATION OF RANDOM FOREST METHOD TO PREDICTION OF STUDENT CANDIDATES ACCEPTED IN THE SNMPTN PATHWAY (CASE STUDY AT UNIVERSITAS LAMBUNG MANGKURAT)

Academic planning is an essential aspect that needs to be carried out to plan the teaching and learning process in a campus, such as the admission of new students through the SNMPTN. At Lambung Mangkurat University, it is known that the partici- pants who took the SNMPTN during the 2021 admission period amounted to 7,703. It is recognized that selecting candidates is not easy due to many prospective students passing the selection but choosing to withdraw. Therefore, a system is needed to predict the graduation of prospective students through the SNMPTN. This research utilizes the Random Forest method to predict the graduation of prospective students through the SNMPTN. The data will be divided into 90% for training data and 10% for testing data, then using classification parameters with 300 n-estimators. The research yielded a precision value of 0.72, recall value of 0.46, and system accuracy of 89.3% For further research recommendations, other prediction methods can be explored to forecast the graduation rate of students through the SNMPTN, or a comparison of methods can be con- ducted to determine which method is more effective.

Geographic Proximity of Medical Students to PM&R Residency Programs is Associated with Increased Match Rates into PM&R.

Despite the growing popularity of Physical Medicine & Rehabilitation (PM&R) as a specialty among medical students, meaningful experiences and mentorship can be challenging to obtain and may significantly vary depending on opportunities available to interact with physiatrists. This study explores the association between the geographic proximity of PM&R residency programs to medical schools and the match rate of medical students into PM&R from 2019 to 2021. Data on US medical schools, graduates, and PM&R residency programs were collected from publicly available sources, and a sample of 1,193 PM&R residents from US medical schools was analyzed using a one-sample proportion test. The proportion of PM&R residents originating from medical schools with PM&R residency programs in the same metropolitan area was significantly greater than the corresponding proportion of expected residents based on medical school graduates, even when controlling for medical school affiliations with PM&R residency programs. These findings suggest that exposure and opportunities provided by PM&R residency programs may influence nearby medical students and that expanding residency programs into geographic regions without existing PM&R programs may foster interest and promote growth in the field of physiatry.

Trends in research grant applications and outcomes among medical students in the United Kingdom: a national self-reported cross-sectional survey.

Background: Research funding disparities contribute to clinical-academic workforce inequalities1-3. Hence, our study explores the association between student demographics and research grant application rates and outcomes among UK medical students. Methods: This is a national multicentre cross-sectional survey of UK medical students in the 2020-21 academic year. Multiple zero-inflated negative binomial regression and generalized linear model (binomial distribution; logit link) were utilized to investigate the association between student demographics, number of grant applications submitted, and successful grant applications (yes or no). P-values less than a Bonferroni-corrected significance level of 0.05/36 = 0.0014 were statistically significant. Results: 1528 students participated from 36 medical schools. 151 respondents (9.9%) had applied for research grants. Black students submitted applications 2.90 times more often than white students [Incident rate ratio (IRR): 2.90, 95% confidence interval (CI): 1.37-6.16], with no ethnic disparity in the odds of successful applications. Gender did not influence application rates significantly (P = .248), but women were 4.61 times more likely to secure a grant than men [odds ratio: 4.61, 95% CI: 2.04-10.4]. Being a PubMed-indexed author was associated with increased grant application submission rates [IRR: 3.61, 95% CI: 2.20- 5.92] while conducting more research was associated with greater odds of securing a grant [odds ratio: 1.42, 95% CI: 1.17- 1.73]. Conclusion: Although black students submitted more applications, ethnicity did not influence success rates. Gender did not influence application rates, but women were more successful. These findings underscore the need for strategies supporting women and underrepresented students for continued academic achievement after graduation. This abstract has been published as a paper4

Application effect of BOPPPS teaching model on fundamentals of nursing education: a meta-analysis of randomized controlled studies

BackgroundBOPPPS (bridge-in, learning objective, pretest, participatory learning, posttest, and summary) is a student-centered, closed-loop teaching model that emphasizes real-time communication and feedback.ObjectivesThe purpose of this study was to review and evaluate the effect of BOPPPS teaching model in “Fundamentals of Nursing” teaching.MethodsWe conducted a meta-analysis of randomized controlled trials (RCTs) based on the BOPPPS teaching model in “Fundamentals of Nursing” teaching. To review domestic and foreign databases for the period 2010 to September 2023. Finally, 13 RCTs were included and the teaching outcomes were measured and analyzed. Two researchers independently identified, selected, and extracted data from the study and examined the risk of bias. The primary outcomes were students’ examination scores (theoretical scores: scores obtained in the nursing fundamentals course, reflecting students’ understanding and mastery of the course content; practical scores: assessment results based on practical application or experimental skills, evaluating students’ practical skill level). The secondary outcomes were self-learning ability score: indicators assessing students’ self-directed learning ability, reflecting their competence in independent learning and autonomous exploration; and satisfaction rate of teaching effect: the overall satisfaction rate of students with the teaching effects experienced during teaching process reflects the proportion of students’ acceptance and satisfaction with the teaching program. The results were evaluated using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) profiler software. The GRADE profiler software is used to assess and grade the recommendations according to the GRADE (Grading of Recommendations Assessment, Development, and Assessment) criteria.ResultsA total of 13 studies were included, consisting of 2,991 nursing students. Among them, 1,465 students were in the BOPPPS teaching group, while 1,526 students were in the traditional teaching group. The summary analysis of the main outcomes showed that the BOPPPS teaching model had significantly higher scores in theoretical score (MD = 3.35, 95% CI: 2.35–4.35, Z = 6.56, p < 0.00001), practice score (MD = 4.50, 95% CI: 1.95–7.05, Z = 3.45, p = 0.0006), and self-learning ability score (MD = 6.76, 95% CI: 5.38–8.14, Z = 9.60, p < 0.00001) compared to the traditional teaching group. The satisfaction rate of students in the BOPPPS teaching group regarding teaching effectiveness was 89% (95% CI = 0.84–0.93). The differences were statistically significant (p < 0.05). The GRADE evidence level for theoretical score and satisfaction rate of teaching effect is low. The evidence level for practice score is very low, and for self-learning ability score is moderate.ConclusionThe BOPPPS teaching mode is helpful to improve the theoretical score, practice score, and self-learning ability score of “Fundamentals of Nursing,” and improve the satisfaction rate of students to the teaching effect. The teaching effect is better than the traditional teaching method.

Enhancing self-learning skills and quality through formative actions and feedback within chemistry classes in the laboratory – A useful model

In here a novel method is described to improve student success rates in a first-year basic chemistry theoretical/practical hybrid course (n = 31 students) by implementing simple ways of formative assessment. This to reduce student dropout rates following the philosophy of encouraging students’ self-control. Essential is to train first-year bachelor students in their self-learning skills and to enhance their evaluative judgment. As a result, students are able to provide better quality of the assessment products at the end of the course. In practice the course is redesigned and intervention tools are integrated at multiple levels throughout the course. The lecturers’ role was adapted to a coaching role, thereby introducing low-effort personalized micro-interventions to meet the personalized needs of students. To clarify these learning needs for students, awareness of the quality desired for the final assessment products is important. Awareness was improved by providing examples of varying quality and introducing multiple peer- and self-assessment moments during the course. The final evaluation of the course examination products showed that the quality of the laboratory notebook was substantially higher after following this approach. Additionally students learned other important skills such as self-learning skills, collaborating in practical work and giving and receiving feedback. Unexpectedly, the high perceived lecturers’ workload decreased. The work presented here provides a novel approach in the form of a model and a practical blueprint with tools for a practical chemistry course design which develops students’ self-learning skills thereby substantially improving student success rates. In our example course, the ultimate student success rate increased form 83 % to 95 % after using this novel approach.

AN EMPIRICAL STUDY OF POTENTIAL FACTORS IMPACTING STUDENT SATISFACTION – A STUDY FOCUSED ON STUDENTS LIVING IN THE NORTH OF ALBANIA AND ATTENDING PUBLIC UNIVERSITIES (CASE: UNIVERSITY OF SHKODRA, UNIVERSITY OF TIRANA AND THE UNIVERSITY OF MEDICINE, TIRANA

Objective: This study aims to explore the factors influencing student satisfaction among attendees of public universities in the northern region of Albania, against the backdrop of declining student enrollment and significant emigration trends. Theoretical Framework: Student satisfaction is understood as a crucial aspect of educational evaluation, influenced by various factors such as educational experiences, services, and facilities (Chatzoglou et al., 2021). Emphasis is placed on understanding the interplay between demographic variables and their impact on satisfaction levels. Method: Data was collected via questionnaires distributed to students at the University of Shkodra, Tirana, and the University of Medicine in 2023. Factor and reliability analyses were employed to identify significant factors affecting student satisfaction. Multiple regression analysis was conducted, with variables including reputation, cost of study, course quality, employability prospects, and service quality. Results and Discussion: The findings indicate that demographic variables exhibit a notable influence on student satisfaction levels. Moreover, the regression analysis identified several factors—such as reputation, cost of study, and service quality—as significant predictors of student satisfaction. Research Implications: This study contributes to understanding the nuanced dynamics of student satisfaction within the Albanian higher education context. The findings hold implications for university administrators and policymakers in devising strategies to enhance student satisfaction and address the challenges of declining enrollment. Originality/Value: By focusing on the specific context of northern Albanian public universities, this research sheds light on understudied aspects of student satisfaction amidst broader socio-economic challenges. The study's findings underscore the importance of tailored interventions to improve overall student experiences and retention rates.

Barriers to implementing problem-based learning at the school of medicine of Debre Berhan University, Ethiopia

BackgroundImplementing PBL in teaching and learning can be challenging due to a variety of complex barriers. Studies on barriers to the implementation of problem-based learning in Ethiopia are scarce. This study aimed to explore the barriers to the implementation of problem-based learning at the Debre Berhan University Medical School.MethodsA qualitative study was conducted among faculty and medical students at the medical school. Purposive sampling was used to select participants. Semi-structured interviews were conducted with tutors and academic leaders, including the problem-based learning coordinator, the biomedical sciences coordinator, and the school dean. Data was also collected from students through focus group discussions. All interviews and discussions were recorded. The four steps of data analysis of Spradley, including domain analysis, taxonomic analysis, componential analysis, and theme analysis, were employed.ResultsThe study identified student-related, tutor-related, case scenario-related, and assessment-related barriers as the most significant obstacles to implementing problem-based learning. These barriers included work overload for both students and tutors, lack of training and experience among tutors, student reluctance, absence of standardized case scenarios, subjectivity of assessment methods, and on-the-spot assessment of students.Conclusions and recommendations: Lack of both tutor and student commitment, lack of standardized cases, absence of a recognition of staff input, gap in communication skills, work overload, lack of continuous training, and at-spot evaluation of students were identified as the main barriers to the implementation of PBL.

Factors affecting the passing rate of licensure examination for teachers at Sulu State College

Factors affecting the passing rate of licensure examination for teachers at Sulu State College

Performance and Perception of Creativity and Academic Achievement in Elementary School Students: A Normal Mixture Modeling Study

ABSTRACTCreativity can be assessed using various methods, including divergent thinking performance, self‐ratings, and teacher ratings. However, these measures may not always align, as they may not consistently identify creative potential in the same manner. The present study aimed to identify latent subgroups of students based on their observed originality, creative self‐efficacy, teacher‐rated originality, academic achievement in reading and mathematics, and demographic background characteristics. Data were collected from 243 elementary school students. We applied the normal mixture technique to classify participants into latent subgroups. Five latent subgroups of students were identified: Overconfident Low Performers, Creative High Achievers, Under‐Confident Below‐Average Achievers, Mathematically Oriented Students, and Calibrated Above‐Average Achievers. Female students tended to fall disproportionately into the subgroup of Creative High Achievers. Students receiving free/reduced lunch had a lower probability of being Creative High Achievers. Special education students had a higher probability of falling into the subgroup Overconfident Low Performers. Teacher ratings of students' originality were more in line with student academic performance rather than with their performance‐based originality scores. Students' self‐ratings of creativity bifurcated across subgroups, with Creative High Achievers and Overconfident Low Performers reporting the highest self‐ratings of originality, despite displaying very different levels of performance on the divergent thinking assessment.

Music with Repeated Sprint Training Impacts on Respiratory Rate and Speed Performance of Students with Visual Impairment

Visual impairment, also known as vision impairment, is a medical definition primarily measured based on an individual's better eye visual acuity; in the absence of treatment such as corrective eyewear, assistive devices, and medical treatment– visual impairment may cause the individual difficulties with normal daily tasks including reading and walking. Visual or vision impairment (VI or VIP) is the partial or total inability of visual perception. To achieve these study fifteen male students with visual impairment (b2)were selected from the, Star Special School in Coimbatore, Tamil Nadu. Their age ranged between 15 to 20 years. These subjects were gone for repeated sprint training on daily 60 minutes morning 6 to 7 am up to eight weeks. The selected respiratory rate assessed with manual method and speed performance assessed with 50 m dash. Pre and post-test data were collected and analyzed using the dependent ‘t’ test, with a confidence level set at 0.05. The findings of the study revealed significant changes in respiratory rate and improvements in speed performance intervention of repeated sprint training.

Acceptability of Racial Microaggressions From the Perspective of Speech-Language Pathology Students.

Implicit racial and ethnic biases have been documented across a variety of allied health professions; however, minimal research on this topic has been conducted within the field of speech-language pathology. The purpose of this study was to understand implicit racial and ethnic bias in speech-language pathology students by examining their perceptions and attitudes about the acceptability of racial and ethnic microaggressions. We also examined whether the student ratings varied by their racial and ethnic identity (White vs. people of color [POC]). Fifty-nine students (72% White, 28% POC) currently enrolled in a speech-language pathology program voluntarily completed the Acceptability of Racial Microaggressions Scale via an online Qualtrics survey. Although 70% of the student ratings classified the microaggressive statements as unacceptable, 30% of their ratings classified the statements as either (a) acceptable or (b) neither acceptable nor unacceptable. Although both groups of students rated the majority of statements as unacceptable, students who self-identified as White rated more statements as acceptable than students who self-identified as POC. Findings indicating relatively high rejection of microaggressive statements by speech-language pathology students are promising. However, responses were not uniform, and a nontrivial proportion of responses provided by speech-language pathology students reflected passivity toward or active endorsement of microaggressive statements.

Early Prediction of Students Performance in Higher Education

Evaluating students' learning performance is a fundamental aspect of evaluating any educational institution. When addressing challenges related to the learning process, student performance is critical, and it is one of the key factors used to quantify learning outcomes. The topic of research known as educational data mining (EDM) has grown out of the potential to leverage data knowledge to enhance educational systems. EDM is the development of methods to analyze data collected from educational environments, enabling a more complete and precise understanding of students and the enhancement of their educational results. Evaluating the students' learning results is a crucial part of evaluating any educational institution. One of the key variables used to quantify learning outcomes is student performance, which is significant when addressing problems with the learning process. The field of research known as educational data mining, or EDM, was born out of the potential to leverage data knowledge to enhance educational systems. EDM is the process of developing methods for evaluating information obtained from educational environments. This makes it possible to learn more precise and in-depth information about students and enhances their academic achievement. Academic achievement tests (AAT), general aptitude tests (GAT), admission scores, first-level courses, and other early-stage factors are used in the paper's dimensionality reduction mechanism by T-SNE algorithm for the clustering technique. This allows the study to investigate the relationship between these aspects and GPAs. Regarding the categorization method, the study showcases tests conducted on various machine learning models that forecast student achievement in the initial phases by utilizing diverse attributes such as course grades and entrance exam results. To gauge the models' quality, we employ various evaluation measures. Based on the findings, it appears that early student failure rates can be reduced by educational institutions.

Impact of Growth, Purpose, and Sense of Belonging (GPS) Mindset Intervention on Student Retention Rates in Asynchronous Mathematics Courses

This study aims to study the effects of incorporating a Growth, Purpose, and Sense of Belonging (GPS) mindset intervention on student retention rates within asynchronous mathematics courses. Specifically, the research hypothesis suggests that integrating the GPS mindset intervention into these courses will yield a statistically significant improvement in student retention rates. Data were collected from Calculus III, Differential Equations, and Linear Algebra courses across multiple semesters—Fall 2018, Spring 2019, Fall 2022, and Spring 2023 to evaluate the impact. Comparative analysis was performed to explore the effectiveness of the intervention. Preliminary findings from the study indicate that the GPS mindset intervention plays a pivotal role in elevating student retention rates in asynchronous mathematics courses. These results contribute to the ongoing discourse on academic retention strategies and underscore the potential benefits of mindset interventions in educational settings.

Effects of Acupuncture on Autonomic Nervous System Parameters and Salivary Cortisol Level Among Mental Stress University Students: A Pilot Randomized Controlled Trial

Stress is a common and often unavoidable aspect of daily life that can negatively impact the autonomic nervous system, which controls the functions of internal organs and glands. Chronic stress has been associated with an imbalance in autonomic nervous system function, leading to a range of health conditions. Acupuncture is a medical treatment modality that has been applied to health care in different dimensions including physical, mental, and spiritual. This study aimed to investigate the effect of acupuncture on blood pressure, heart rate, and salivary cortisol level in mild stress university students, a population particularly vulnerable to stress. Twenty-eight university students were recruited and divided into two groups, a real acupuncture group and a sham acupuncture group. Heart rate, blood pressure, and salivary cortisol level were evaluated before and after a 30-minute acupuncture session on the ST36 acupoint. The results showed that the real acupuncture group had a significant decrease in blood pressure and heart rate, whereas the sham acupuncture group showed no change. Both groups had a slightly decrease in salivary cortisol level with no statistically significant. There was a statistically significant difference in the decrease of systolic blood pressure and heart rate after acupuncture between the two groups, but there was no significant difference between the groups in salivary cortisol level after acupuncture. The findings suggest that the acupuncture can be a valuable treatment for restoring balance to the symptoms of the autonomic nervous system in university students experiencing stress. A larger sample size, a non-intervention control, as well as different sources and times of cortisol collection, could contribute to the validation of the findings in this study.

Driving Accessibility: Tarrant County College’s Online Campus Races Toward Accessibility for Online Courses and Communication?

This article presents Tarrant County College Connect Campus's initiative to enhance accessibility in online courses and communication. It highlights the challenges of compliance with state and federal accessibility regulations in higher education and the legal, financial, and human impacts of non-compliance. The study discusses the disproportionately lower accommodation rates for students with disabilities at two-year colleges compared to four-year institutions. The TCC Connect Campus Accessibility Roadmap (CAR) is introduced as a comprehensive approach to creating accessible learning environments, including continuous improvement plans to align with changing regulations and new technologies.   

Co-Creating with Students to Promote Science of Learning in Higher Education: An International Pioneer Collaborative Effort for Asynchronous Teaching

Recent insights from Science of Learning (SoL) are informing instruction, training, and curriculum. Here, we present a partnership project on promoting SoL-related content through co-creating online asynchronous learning resources. By building a 7-person cross-institution student-faculty partnership team, we strategically harnessed (1) student-faculty partnerships as a mechanism to promote training and professional development, (2) co-creation as a model to curricula development, (3) blended asynchronous learning as a modality for content delivery, and (4) internationalization as a strategy to embrace globalization. Our co-creation of curricula project included three stages—literature review, design and production, and evaluation. The subsequent evaluation deployed a mixed methods approach with 6 student evaluators across both participating institutions, who explored the effectiveness of our resources. To complete our evaluation, student partners contributed reflective statements on their co-production experience. This paper reports on the procedural pipeline to co-creation, the outcomes of our evaluation, and on new insights emerging for curriculum development. Our evaluation posits that project outcomes may enhance effectiveness of instructional design and students’ learning experience. Further, we demonstrate that student partners acquire new knowledge and research, design and delivery skills, futureproofing their academic progression.

Analyzing Novice and Competent Programmers' Problem-Solving Behaviors Using an Automated Evaluation System

Background and ContextIn today's tech-driven world, programming courses are crucial. Yet, teaching programming is challenging, leading to high student failure rates. Understanding student learning patterns is key, but there's a lack of research utilizing tools to automatically collect and analyze interaction data for insights into student performance and behaviors. ObjectivesStudy aims to compare problem-solving behaviors of novice and competent programmers during coding tests, identifying patterns and exploring relationships with program correctness. MethodWe built an online system with programming challenges to collect behavior data from novice and competent programmers. Our system analyzed data using various metrics to explore behavior-program correctness relationships. FindingsAnalysis showed distinct problem-solving behavior patterns. Competent programmers had fewer syntax errors, spent less time fixing bugs, and had higher program correctness. Novices made more syntax errors and spent more time fixing coding errors. Both groups used tabs for code structure, but competent programmers introduced unfamiliar variables more often and commented on them afterward. Emphasizing iterative revisions and active engagement enhances problem-solving skills and programming proficiency. Radar charts are effective for identifying improvement areas in teaching programming. The relationship between behavior and program correctness was positively correlated for competent programmers but not novices. ImplicationsStudy findings have implications for programming education. Radar charts help teachers identify course improvement areas. Novices can learn from competent programmers' behavior. Instructors should encourage continuous skill improvement through revisions and engagement. Identified unfamiliar programming aspects offer insights for targeted learning.

The Effects of the COVID-19 Pandemic on Nursing Education Programs.

The U.S. Boards of Nursing (BONs) collect annual report data from their nursing programs as part of their approval process. This paper highlights the 2020 and 2021 annual report data on the effect of coronavirus disease 2019 (COVID-19) on all nursing programs in 17 BONs in 2020 and 19 in 2021. Nursing programs answered 16 questions on the effect of COVID-19 on their programs. Because BONs require annual report data, all programs in the participating states answered the questions, which included 798 programs in 2020 and 929 in 2021. Major disruptions in nursing education occurred during the pandemic. Clinical experiences and didactic classes were greatly affected, though alternative strategies were used. Student and faculty attrition rates were particularly high in 2021. The authors call for a national forum where nurse leaders analyze what happened and make recommendations for future crisis events. [J Nurs Educ. 2024;63(5):312-319.].

Assessing the clinical reasoning skills of 4th year medical students in Batna

Aim. With the aim of examining the performance, commitment and perception of 4th year medical students in Batna - Algeria with regard to an interactive preparatory tool used in a flipped neuromeningeal infection course and to compare results with other types of teaching including blended as well as distance learning during COVID19. Methods. we conducted a prospective, evaluative, experimental before-and-after study with comparison maneuvers. Through this study, the success rate of external students 2022-2023 receiving "Reverse Classroom" teaching applied on group A was compared to the success rate of external students of the same year receiving "mixed teaching" applied on group B and to the success rate of external students of the year 2020-2021 (During COVID 19), receiving only "online teaching in downloadable papers" applied on group C consisting of 2 subgroups . All students in group A and B have access to a traditional downloadable paper document coupled with an enhanced e-learning tool including a video. We briefly evaluated this interactive tool during a 01:30-hour lecture in the form of a clinical case, with the same amount of dedicated class time for both subgroups. Results: Overall, our evaluation showed that the use of the flipped classroom approach is appreciated by students and helps them to learn, understand and retain the essential notions of the course, objectively demonstrated by their response to question 2, 3 and 4, and whose acquisition of the course reached 60% (33.3, 37.1) and 80% (56.0, 49.4) respectively for the A1 and A2 group. The majority asked to adopt it in nearly 67% of cases, which has been reported in studies other. Similarly, our results show the importance of having direct contact with a teacher and feedback during a lecture, and of not exclusively carrying out distance learning without direct contact interaction and feedback. Conclusion: The flipped classroom defines a blended learning approach in which core content is transferred to students to engage them in active learning exercises during class time.